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© Image processing method and apparatus for converting between data coded in different formats. 



@ Image processing method and apparatus for 
converting between data encoded in different 
formats includes structure and steps for con- 
verting motion image data into first digital 
coded motion image data having a first encod- 
ing format and capable of being transmitted to a 
medium. The first digital coded motion image 
data is then converted into second digital coded 
motion image data without decoding entirely 
the first digital coded motion image data. The 
second digital coded motion image data has a 
second encoding format different from the first 
encoding format. Preferably, the second digital 
coded motion image data has a digital data 
amount which is less than that of the first digital 
coded motion image data. 



. DECODING 
CIRCUIT 




DISPLAY 
DEVICE 





<3 
u. 




Jouve, 18, rue Saint-Denis, 75001 PARIS 



1 



EP 0 661 885 A1 



2 



BACKGROUND OF THE INVENTION 
Field of the Invention 

This invention relates to image processing meth- 
od and apparatus for converting image signals be- 
tween encoding formats, and more particularly to 
method and apparatus for encoding first digital en- 
coded motion image signals into second digital en- 
coded motion image signals of a different format. 

Description of Related Art 



compression rate method. 

Moreover, when the system is connected to a low 
communication rate line, even if the encoder encodes 
the motion image data using a high compression rate, 
5 the reproduced image will not be as good as a high 
quality image. 

A low communication rate line cannot transmit 
data encoded by the MPEG method in real time be- 
cause the data rate of the MPEG method is higher 
10 than that of the H.261 method. Therefore, a low com- 
munication rate line used only for TV conferencing or 
a video telephone cannot transmit in real time the mo- 
tion image data encoded by the MPEG method. To 
transmit the data encoded by the MPEG method in 
real time, it is necessary to change the communica- 
tion line to a high communication rate line that has 
enough transmitting capacity for transmitting that 
data encoded by the MPEG method. 

These shortcomings will also occur when other 
data compression methods are used having different 
compression rates, 

SUMMARY OF THE INVENTION 

A concern of the present invention is to solve or 
alleviate the above-explained shortcomings. 

Another concern of the present invention is to 
provide method and apparatus for generating differ- 
ent kinds of coded data having different compression 
rates. 

Still another concern of the present invention is 
to provide method and apparatus for transmitting 
coded data through different kinds of transmission 
media having different communication rates. 

Still another concern of the present invention is 
to convert data coded by the MPEG method to data 
coded by the H.2§1 method, or vice versa. 

According to one aspect of the present invention, 
there is provided an image processing method com- 
prising the steps of (i) providing first digital coded im- 
age data having a first encoding format and capable 
of being transmitted to a recording medium, and (ii) 
converting the first digital coded image data into sec- 
ond digital coded image data without decoding entire- 
ly the first digital coded image data, the second digital 
coded motion image data having a second encoding 
format different from the first encoding format. Pre- 
ferably, the second digital coded motion image data 
has a digital data amount which is less than that of the 
first coded image data. 

According to another aspect of the present inven- 
tion, an image processing apparatus comprises pro- 
viding means for providing first coded motion imajge 
data having a first encoding format capable of being 
transmitted to a recording medium. Converting 
means is provided for converting the first coded mo- 
tion image data into second coded motion image data 
without decoding entirely the first coded motion im- 



In a system for recording and/or monitoring an im- 
age signal from a video camera to a digital video re- 15 
corder (located at a distance from the video camera) 
through a communication line, a high quality image 
encoding method is typically used for recording, and 
a high compression rate image encoding method is 
typically used for monitoring. 20 

The high compression rate method is used in the 
image encoding method for monitoring because the 
data communication rate of the communication line is 
typically limited. 

To achieve a high quality image for monitoring, 25 
however, a lower compression rate is used in the im- 
age encoding method. However, the lower compres- 
sion rate encoding method needs a communication 
line that has a data communication rate equal to that 
of the digital recorder. Therefore, the system is limited 30 
by the communication line, or it is necessary to re- 
duce the quality of the image. Alternatively, two en- 
coders may be provided, each having a different com- 
pression rate. Therefore the construction of the appa- 
ratuses used in the above-described systems is com- 35 
plex. This is a problem to be solved. 

The MPEG-I (Motion Picture Experts Group - I) 
encoding method for storing motion image data, and 
the H.261 encoding method for communicating mo- 
tion image data are known. The compression rate of 40 
the MPEG method, whose bit rate is 1.5 Mbit/sec, is 
relatively low. The algorithm of this method is com- 
plex because the method emphasizes image quality 
over real time encoding. 

In contrast, the compression rate of the H.261 45 
method, whose bit rate is P x 64 kbit/sec (where P is 
an integer), is relatively high. The algorithm of this 
method is simple because it emphasizes real time en- 
coding. However, when transmitting the encoded mo- 
tion image data produced by the H.261 method, it is so 
required to encode motion image data into encoded 
data whose bit rate is less than or equal to the rate of 
the communication line. 

Furthermore, even when the system is connected 
to a high communication rate line, the reproduced in> 55 
age will only be as good as the encoder coupled to the 
communication line, which is a problem when the en- 
coder encodes the motion image data using a high 
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age data, the second coded motion image data hav- 
ing a second encoding format different form the first 
encoding format and, preferably, having a digital data 
amount which is less than that of the first coded mo- 
tion image data. 

The foregoing and other features and advantag- 
es of the present invention will become fully apparent 
from the following description to be taken in conjunc- 
tion with attached drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 



15 is a decoding circuit for decoding the motion image 
data received by the receiving circuit 14. 16 is a dis- 
play device for displaying an image corresponding to 
the decoded motion image data. 17 is a record con- 
5 trailer for controlling the recording of the encoded sig- 
nal onto a recording medium 18. 18 is the recording 
medium. 

The operation of the first embodiment as illustrat- 
ed in Fig. 1 will now be explained. The motion image 
10 data input device 10 converts motion image data 
from e.g., a video camera into digital motion image 
data and outputs the digital image data to the first en- 
coding circuit 11. 

The first encoding circuit 11 encodes the digital 
motion image data by using a relatively low compres- 
sion rate parameter. The first encoding circuit per- 
forms the encoding operation using, e.g., the MPEG 
method. The data encoded by the first encoding cir- 
cuit 11 is transmitted to the record controller 17, and 
is recorded on the recording medium 18. 

The second encoding circuit 12 produces second 
encoded digital data by replacing a portion of the dig- 
ital data encoded by the first encoding circuit 11 with 
a copy command. This replacement operation will be 
explained later (see e.g. Figs. 5(a)-5(c)). The encod- 
ed data produced by the second encoding circuit 12 
is transmitted to receiving circuit 14 through the 
transmission circuit 13, and is decoded by the decod- 
ing circuit 15. Therefore the display circuit 16 displays 
an image corresponding to the signal output by the 
decoding circuit 15. 

Fig. 2 is a block diagram of the first encoding cir- 
cuit 11 illustrated in Fig. i. 

Referring to Fig. 2, 30 is an encoding mode deci- 
sion circuit for generating an instruction to change the 
circuit between an inter frame encoding mode and an 
intra frame encoding mode (to be described below). 

31 is a differential generating circuit for obtaining 
a differential between an encoded frame and a frame 
to be encoded in an inter frame encoding operation, 
and for performing motion compensation based on a 
motion vector received from motion vector detecting 
circuit 34 (to be described below). Circuit 31 also may 
output a frame to be encoded, as it is, in an intra 
frame encoding operation. 

32 is an orthogonal transformation circuit for 
transforming input image data into frequency compo- 
nents. 33 is a quantization circuit for quantizing the 
output from the orthogonal transformation circuit 32 
in accordance with an output of a code amount mon- 
itor circuit 35 (to be described below). 34 is a variable 
length encoderfor encoding the outputf rom the quan- 
tization circuit 33. 35 is the code amount monitor cir- 
cuit for monitoring the code amount (i.e., the quantity 
of code, see Figs. 5(a)-5(c) for different code 
amounts) of the code output by said quantization cir- 
cuit 34, and for controlling the quantizing step used by 
the quantization circuit 33. The code amount monitor 



Fig. 1 isa block diagramofafirstembodimentac- 
cording to the present invention. 

Fig. 2 is a block diagram of the encoder illustrated 15 
in Fig. 1. 

Figs. 3(a), 3(b), 3(c) comprise a diagram for ex- 
plaining the plural encoding modes of the Fig. 2 en- 
coder. 

Fig. 4 is a diagram of the frame format of the en- 20 
coded motion image data. 

Figs. 5(a), 5(b), and 5(c) comprise a detailed di- 
agram of Fig. 4. 

Fig. 6 is a block diagram of a fourth embodiment 
according to the present invention and enables trans- 25 
mission through plural communication lines. 

Fig. 7 is a block diagram of a fifth embodiment ac- 
cording to the present invention. 

Fig. 8 is a diagram for showing a format of data 
encoded by the MPEG method. 30 

Fig. 9 is a detailed diagram of code conversion 
circuit 102 of Fig. 7. 

Fig. 10 is a detailed diagram of an alternative con- 
struction of code conversion circuit 102 of Fig. 7. 

Fig. 11 is a diagram of a seventh embodiment ac- 35 
cording to the present invention. 

Fig. 12 is a detailed diagram of conversion device 
150 described in Fig. 11. 

DETAILED DESCRIPTION OF THE PRESENTLY 40 
PREFERRED EMBODIMENTS 

First Embodiment 

Fig. 1 is a block diagram of a first embodiment ac- 45 
cording to the present invention. 

Referrir ; *o Fig. 1 , 1 0 is a motion image data in- 
put device for inputting digital motion image data. 11 
is a first encoding circuit for encoding the motion im- 
age data input by the motion image data input device 50 
10. The input device 10 and the first encoding circuit 
11 may comprise a digital video camera. 12 is a sec- 
ond encoding circuit for further encoding the motion 
image data encoded by the first encoding circuit 11. 
1 3 is a transmission circuitfor transmitting the motion 55 
image data encoded by the second encoding circuit 
1 2. 14 is a receiving circuitfor receiving the motion im- 
age data transmitted by the transmission circuit 13. 
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circuit 35 determines the quantization level for a spe- 
cific frame in accordance with the code amount of the 
frame (N-1) before the specif ic frame (N). 37 is a local 
decoder for generating an image to be provided to a 
reproduction circuit (in decoding circuit 15, Fig. 1) by 5 
decoding the encoded image data and outputting it to 
a frame memory 36. 

39 is a motion vector detecting circuit for detect- 
ing motion between an image block of a present 
frame (N) and an image block of a previous frame (N- 10 
1) shown in Fig. 2. 

The encoding mode determined by the encoding 
mode decision circuit 30 will be explained by using 
Figs. 3(a), 3(b), and 3(c). 

There are three encoding modes, one intra frame 15 
encoding mode and two inter frame encoding modes. 
The first encoding mode is the intra frame mode (I 
mode), the second encoding mode is a forward pre- 
diction inter frame mode (P mode), and the third en- 
coding mode is a both direction prediction inter frame 20 
mode (B mode). In the second encoding mode (P 
mode), a motion vector is detected by the motion vec- 
tor detecting circuit 39 between the previously encod- 
ed frame (N-1) and frame to be encoded (N). Motion 
compensation is then performed by the differential 25 
generating circuit 31 after it has obtained the differ- 
ential between the frames (N) and (N-1), and the dif- 
ferential component is processed by circuits 32, 33, 
34 and 35. 

The third encoding mode (B mode) is the both di- 30 
rection prediction mode. In the third encoding mode, 
two motion vectors are detected, one of them being 
a motion vector between the previously encoded 
frame (N-1) and the frame to be encoded (N). The 
other motion vector is one between the following en- 35 
coded frame (N+1) and the frame to be encoded (N). 
The motion is compensated by the circuit 31 with re- 
spect to the (N) frame and the (N-1) and (N+1) 
frames, and two differential components are ob- 
tained, and the smaller one of the two differential 40 
components is processed by circuits 32, 33, 34 and 
35. 

In the P mode and the B mode, a copy command 
is provided for copying the P mode or B mode data 
from the previous frame. The copy command is a 45 
code representing that the differential component be- 
tween the frames is "0" and the motion vector is "0" 
(see Figs. 5(a)-5(c) for the copy command). 

Fig. 4 is a diagram of the frame format of the en- 
coded motion image data obtained by the embodi- so 
ment described in Fig. 2. Frames 1, 5 and 9 are en- 
coded using the I mode, and frames 3, 7 are encoded 
using the P mode referring to frames 1 , 5 respectively. 
Frames 2, 4, 6 and 8 (between frames encoded using 
the I mode and frames encoded using the P mode) 55 
are encoded using the B mode. 

Figs. 5(a), 5(b), and 5(c) comprise a detailed di- 
agram of Fig. 4. 



Fig. 5(a) represents the encoded data output by 
the first encoding circuit 11. The sequence header in- 
cludes information to decode the encoded signal, 
e.g., the number of frames per 1 sec and the size of 
the frame. As shown in Fig. 5(a), I frame encoded 
data, P frame encoded data, B frame encoded data, 
and frame headers for each of the frames are contin- 
uously output following the sequence header. 

Fig. 5(b) is the encoded data in which the B frame 
encoded data from Fig. 5(a) is replaced by the copy 
commands. Fig. 5(b) is output by the second encod- 
ing circuit 12. 

The replacement of the B frame encoded data by 
the copy command is a simple process, and the copy 
command is very short. Therefore, the second encod- 
ing circuit 12 can reduce the amount of encoded im- 
age data by this simple process. 

However, if the encoded data (in which the B 
frame encoded data is replaced by the copy com- 
mand) is decoded, the motion of the decoded image 
may be slightly worse (in accordance with the percen- 
tage of the B frame encoded data in the whole encod- 
ed data of Fig. 5(a)), since the B frame encoded data 
was obtained from a previous frame. 

As shown in Fig. 5(c), the copy command can re- 
place not only the B frame encoded data but also the 
P frame encoded data, and the amount of encoded 
image data is further reduced. However, in this case, 
the motion of the decoded image may be even worse 
since the P frame encoded data is also obtained from 
a previous frame. These replacements are performed 
by the second encoding circuit 12. 

According to the present embodiment, a reduc- 
tion in the amount of the encoded image data, as 
shown in Figs. 5(a), 5(b), and 5(c) can be obtained, 
and decoding the encoded data is also simplified. By 
decoding using software instead of hardware, the re- 
duction in data amount makes the process time short- 
er because in decoding using software, if the total 
commands are reduced, the process time is shorter. 

In software decoding, copy commands can be 
easily detected by a code matching method because 
copy commands are a short commands. The detected 
copy commands are converted into freeze com- 
mands sent to frame memory without really perform- 
ing a copying operation of the decoded image data. 
In hardware decoding, performing the copy com- 
mands exactly is also easy because the copy com- 
mand is a short command that is easily handled. How- 
ever, the software method is presently preferred be- 
cause detecting the copy commands by the code 
matching method and replacement of the command 
by a freeze command is simpler. 

Therefore, according to the present embodiment, 
the decoding process can be simpler both in software 
decoding and in hardware decoding. 
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Second Embodiment 

In case the transmission line for transmitting the 
encoded data is not a fixed data communication rate 
line, but a variable data communication rate line (such 5 
as a local area network), it is possible to control the 
amount of transmitted encoded data by selecting one 
of the data shown in Figs. 5(a), 5(b), or 5(c) in accor- 
dance with the traffic detected on the line. 

In detail, if the traffic is light, the frequency of the 10 
replacement of the data with the copy command can 
be made less. If the traffic is heavy, the frequency of 
the replacement of the data with the copy command 
can be made larger. This can be determined and ad- 
Justed by controller 1 7. 15 

Third Embodiment 

In previous embodiments, the sequence header 
of the encoded data output by the first encoding cir- 20 
cuit 11 and the second encoding circuit 12 are the 
same. However, it is also possible to change the num- 
ber of frames per sec included in the sequence head- 
er of the encoded data output by the second encoding 
circuit 12. 25 

In this case, B frame encoded data is deleted 
from the output of the first encoding circuit 11, without 
replacing B frame encoded data with the copy com- 
mand, so that code data including only I frame coded 
data and P frame coded data are generated. Alterna- 30 
tiveiy, code data including only I frame coded data is 
generated. 

These replacements can be performed by the 
second encoding circuit 12 controlled by controller 
17- 35 

Fourth Embodiment 

This invention can also be applied to a process 
wherein the image data from a single motion image 40 
data input device 10 is transmitted simultaneously 
through plural lines A, B, and C whose transmission 
rates are different from each other. 

Referring to Fig. 6, plural second encoding cir- 
cuits 70-1 , 70-2, 70-3 and a controller 700 (for con- 45 
trolling each of the plural second encoding circuits) 
are provided in cr6& to select one of the plural out- 
puts shown in Figs. 5(a), 5(b) and 5(c) independently 
for each channel. Each of the second encoding cir- 
cuits 70-1, 70-2, 70-3 is respectively connected to 50 
each of second record/communication circuits 71-1, 
71-2, 71-3. 

In the above described embodiment, it is possible 
to record high quality images on one channel and to 
suppress the amount of data to be transmitted on a 55 
different channel. 



Fifth Embodiment 

Fig. 7 is a block diagram of a fifth embodiment of 
the present invention. Referring to Fig. 7, 1 01 is an in- 
put controller for inputting encoded motion image 
data through an external communication line 104, 
and for separating the data into video data 106 and 
audio data 105. 102 is a coded data converting circuit 
for converting video data 106 and audio data 105 into 
other forms 108, 107, respectively (e.g. MPEG to 
H.261, to be described more fully below). 103 is an 
output controller for transmitting converted video 
data 108 and converted audio data 107 through the 
external communication line 109. 110 represents a 
whole image data conversion circuit 

In this embodiment, the motion image encoded 
data input through line 104 is encoded by the MPEG 
method and the motion image encoded data to be out- 
put is encoded by the H.261 method, i.e., image data 
conversion circuit 110 converts data encoded by the 
MPEG method into data encoded by the H.261 meth- 
od. 

Fig. 8 is a diagram for showing a format of data 
encoded by the MPEG method. 

In this embodiment, I frame encoded data 21, 22 
of the motion image data encoded by the MPEG 
method is generated every 15 frames, and each 
frame is encoded at a rate of 30 frames per sec. On 
the other hand, in the H.261 method, each frame is 
encoded at a rate of 2 frames per sec. 

Fig. 9 is a detailed diagram of the code converting 
circuit 1 02 of Fig. 7. In Fig. 9, 1 30 is a video converting 
circuit for converting video data 106 into video data 
108 that is suitable for the H.261 method, and 131 is 
an audio converting circuit for converting audio data 
105 into audio data 109 that is suitable for the H.261 
method. 

1 32 is a detecting circuit for detecting I frame en- 
coded data (among video data 108) encoded by the 
MPEG method. The detecting circuit 132 detects a 
header included in each frame of the video data 108 
encoded by the MPEG method. 1 33 is a decoding cir- 
cuit for decoding I frame encoded data that is encod- 
ed by the MPEG method, and for outputting decoded 
I frame data. 134 is an encoding circuit for encoding 
the decoded I frame data output by the circuit 133, 
and for outputting I frame encoded data that is suit- 
able to the H.261 method. 135 is a decoding circuit for 
decoding audio data encoded by the MPEG method. 
1 36 is a low pass filter for cutting off a hig h frequency 
component included in the output of the decoding cir- 
cuit 1 35. 1 37 is an encoding circuit for encoding audio 
data, output through the low pass filter 136, in accor- 
dance with the H.261 method. 

In the embodiment shown in Fig. 9, data encoded 
at a 30 frame per sec rate by the MPEG method is 
converted into data encoded at 2 frames per sec in 
accordance with the H.261 method. 
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The I frame encoded data is generated every 15 
frames by the MPEG method in this embodiment; 
therefore only I frame encoded data is decoded, and 
it is converted into data suitable to the H.261 method 
by the video converting circuit 130. 5 

The audio converting circuit 1 31 converts the au- 
dio data encoded by the MPEG method into audio 
data encoded by the H.261 method, as the video con- 
verting circuit 130 converts the video data. However, 
if the encoding rate of the encoding circuit 137 (that 10 
is for H.261) is high, the low pass filter 136 can be de- 
leted. 

To convert image data encoded by the MPEG 
method into image data encoded by the H.261 meth- 
od, it is possible to decode entirely the coded image 15 
data and re-encode the decoded image data, or it is 
possible to decode a required part of the coded image 
data and re-encode the decoded image data. 

The coded audio data will be processed similarly 
to the coded video data. 20 

Sixth Embodiment 

The apparatus described in the fifth embodiment 
extracts only I frame coded data and cor .verts it from 25 
one encoding method to another. The apparatus in 
the sixth embodiment extracts I frame coded data 
and other frames that are not I frame coded data and 
converts them. In this apparatus, data coded at 30 
frames per sec is converted into data coded at 6 30 
frames per sec. 

Fig. 10 is a detailed diagram of another construc- 
tion of the coded data converting circuit 102 of Fig. 7. 
Referring to Fig. 1 0, 140 is a buffer memory including 
a first buffer memory 142 that stores the output from 35 
a MPEG video decoder 143, and a second buffer 
memory 142 that stores data to be input into the 
H.261 video encoder 144. Data transmitted from buf- 
fer 141 to buffer 142 is controlled by a control signal 
145 produced by CPU 149. 40 

As previously mentioned, the apparatus descri- 
bed in this embodiment converts data coded at 30 
frames per sec into data coded at 6 frames per sec. 
Therefore, this apparatus decodes data coded by the 
MPEG method and encodes the decoded data using 45 
the H.261 method. MPEG video decoder 143 de- 
codes inputdata coded by the MPEG method and out- 
puts decoded image data to buffer 141 . CPU 149 pro- 
duce the control signal 145 for buffer 140 such that 
the decoded data is transferred from buffer 141 to so 
buffer 142 every five frames in this embodiment. 

H.261 encoder 144 encodes image data from 
buffer 142 using the H.261 method. The encoding 
processing for the audio data is similar to that of the 
fifth embodiment. 55 

The invention is not limited to 6 frames per sec or 
30 frames per sec as described above. 

Since the data rate of the H.261 method is lower 



than that of the MPEG method generally, the data en- 
coded by the MPEG method is converted into the data 
encoded by H.261 method. However, this invention is 
not limited by the above embodiments; this invention 
can also be applied to a conversion of data encoded 
by the H.261 method into data encoded by the MPEG 
method, or from data encoded by the H.261 method 
into data encoded by the H.261 method (e.g., 8 
frames per second to 2 frames per second), or from 
data encoded by the MPEG method into data encod- 
ed by the MPEG method (e.g., differentf rame rates). 

In the above embodiment, the frame rate of the 
data encoded by the MPEG method is changed. How- 
ever, if the encoder 144, (coupled to the data output 
side) has a function of altering the data transfer rate 
without changing the frame rate, the CPU 149 may 
change the compression rate by e.g. altering the 
quantization level used in the encoder. If plural kinds 
of decoding circuits (e.g., an MPEG decoder and a 
H.261 decoder) are provided, it is possible to select 
one of the plural kinds of decoding circuits in accor- 
dance with the kind of input encoded motion image 
data. 

The encoding portion of the data outputting side 
can be provided with plural kinds of decoders. 

Seventh Embodiment 

The following embodiment utilizes the network 
structural communication lines and communication 
equipment shown in Fig. 11. 

Referring to Fig. 11, 150 is a motion image con- 
version device, 152-1-152-3 are communication 
lines, while 153-1-153-5, 151-1, and 151-2 are com- 
munication devices (e.g. Personal Computers) each 
having a display device. 

In this example, the data transmission rates of 
the communication lines 152-1, 152-3 are 1.5 M 
bit/sec, while the rate of the line 152-2 is 128 K 
bit/sec. A decoder for the H.261 method encoded data 
is provided for each of the communication devices 
153-1-153-5, and a decoder for the MPEG encoded 
data is provided for each of the communication devic- 
es 151-1, 151-2. 

The detail of the motion image conversion device 
150 will now be explained with reference to Fig. 12. 

Referring Fig. 12, 160 is input digital motion im- 
age data, and 161, 162 are output motion image data. 
The output signal 162 is the same as the input signal 
160. The output signal 161 is output from image data 
conversion circuit 110 described in Fig. 7, so the sig- 
nal 161 is converted by the circuit 110 in accordance 
with a given control signal 145 shown in Fig. 10. 

Referring Fig. 11 and Fig. 12, since the commu- 
nication devices 1 51-1 , 151-2 are each provided with 
an MPEG decoder, the signal 162 is transmitted 
through the communication line 152-3 connected to 
the devices 151-1, 151-2. And the signal 161 istrans- 



6 



11 



EP 0 661 885 A1 



12 



mitted through the communication line 152-2 to the 
devices 153-1-153-5. 

The operation of this embodiment, when data en- 
coded by the MPEG method at 1.5 M bit/sec is input- 
ted from an external source, will now be explained. 5 

In this case, the communication devices 151-1, 
151-2 receive the MPEG encoded data at 1.5 M 
bit/sec as it is. The MPEG decoders provided in each 
of the communication devices 151-1, 151-2 decodes 
the encoded data, so the display device of each of the 10 
devices 151-1, 151-2 displays a good quality image 
defined by 1.5 M bit/sec. 

The communication devices 153-1 to 153-5 re- 
ceive the data converted by the image data conver- 
sion circuit 110 through the line 152-2. 15 

The image data conversion circuit 110 converts 
the 1.5 M bit/sec MPEG encoded data into data en- 
coded by the H.261 method at a rate of 128 K bit/sec. 

The H.261 decoders provided for each communi- 
cation device 153-1 to 153-5 decodes the data con- 20 
verted by the conversion circu it 1 1 0, so the display of 
each of the devices 153-1 to 153-5 displays an image 
defined by 128 K bit/sec. 

The motion image conversion process of conver- 
sion circuit 110 can be automatically controlled by 25 
CPU 149 (shown in Fig. 10) in accordance with the de- 
tection of the data transmission rate of the communi- 
cation line. 

In this embodiment, the network supports two 
different transmission rates. However, this invention 30 
is not limited to such an embodiment. This invention 
can be applied to networks which support many dif- 
ferent transmission rates by providing the conversion 
circuit 110 at a switching circuit on the communication 
lines where the data transmission rate may be 35 
changed. Also, the transmission rate is not limited to 
the disclosed 1.5 M bit/sec, or 128 K bit/sec rates. 

Further, the encoding method is not limited to the 
MPEG method and the H.261 method. This invention 
can be applied to the MPEG-II method, the vector 40 
quantizing method, or an encoding method for encod- 
ing all frames by interframe encoding. This invention 
is especially effective in converting between plural 
encoding methods whose frame rates are different. 

In addition, this invention can be applied not only 45 
to motion image data, but also to plural data types 
having correlations with each other. For example, the 
present invention can also be applied to still image 
data. 

Moreover, this invention can be applied not only 50 
to transmissions between a communication line and 
a monitor, but also between other kinds of mediums 
such as disc storage devices, semiconductor memor- 
ies, etc. 

Furthermore, this invention is applicable not only 55 
to systems including computers and software, but 
also to hardware systems. 

According to above-described embodiments, the 



present invention can generate plural kinds of encod- 
ed data whose transmission and/or compression 
rates are different from each other. 

According to the present invention, each of plural 
communication devices can reproduce the most de- 
sirable real-time motion image in accordance with the 
transmission rate of the communication line connect- 
ed to each communication device. 

According to the present invention, the encoding 
method may be easily changed so that when encoded 
data (which is not compatible with the communication 
device) is input, the communication device may nev- 
ertheless display the image corresponding to the in- 
put encoded data. 

The individual components shown in outline or 
designated by blocks in the Drawings are all well- 
known in the image processing arts and their specific 
construction and operation are not critical to the op- 
eration or best mode for carrying out the invention. 

While the present invention has been described 
with respect to what is presently considered to be the 
preferred embodiments, it is to be understood thatthe 
invention is not limited to the disclosed embodiments. 
To the contrary, the invention is intended to cover va- 
rious modifications and equivalent arrangements in- 
cluded within the spirit and scope of the appended 
claims. The scope of the following claims is to be ac- 
corded the broadest interpretation so as to encom- 
pass all such modifications and equivalent structures 
and functions. 



Claims 

1. Image processing apparatus comprising: 

providing means for providing first digital 
coded motion image data having a first encoding 
format and capable of being transmitted to a me- 
dium; and 

converting means for converting the first 
digital coded motion image data into second dig- 
ital coded motion image data without decoding 
entirely the first digital coded motion image data, 
the second digital coded motion image data hav- 
ing a second encoding format different from the 
first encoding format. 

2. Image processing apparatus according to claim 
1, wherein said converting means includes 
means for replacing a particular code of said first 
digital coded image data with a copy code. 

3. Image processing apparatus according to claim 
1, wherein said first digital coded image data in- 
cludes (i) intra frame coded image data and (ii) in- 
ter frame coded image data which is different 
from the intra frame coded image data. 
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4. Image processing apparatus according to claim 
3, wherein said particular code comprises a por- 
tion of said inter frame coded image data. 

5. Image processing apparatus, according to claim 5 
1, wherein said converting means includes 
means for extracting a predetermined code in- 
cluded in said first digital coded image data and 

for outputting the extracted code. 

10 

6. Image processing apparatus according to claim 

5, wherein said first digital coded image data in- 
cludes (i) intra frame coded image data and (ii) in- 
ter frame coded image data which is different 
from the intra frame coded image data. 1 5 

7. Image processing apparatus according to claim 

6, wherein said predetermined code comprises 
intra frame coded image data. 

20 

8. Image processing apparatus according to claim 
1, wherein said providing means comprises a vid- 
eo camera. 

9. Image processing apparatus according to claim 25 
1, wherein said medium comprises a communica- 
tion network. 

10. Image processing apparatus according to claim 

1, wherein said medium comprises a recording 30 
medium. 

11. Image processing apparatus according to claim 
1, wherein said second digital coded motion im- 
age data has a digital data amount which is less 35 
than the digital data amount of the first digital 
coded motion image data. 

12. Image processing apparatus comprising: 

means for inputting first encoded motion 40 
image data having a first frame rate; 

means for converting the inputted first en- 
coded motion image data into second encoded 
motion image data having a second frame rate 
different from said first frame rate, said means 45 
for converting not converting entirely the first en- 
coded motion imao^tfata; and 

means for outputting the second encoded 
motion image data converted by said means for 
converting. 50 

13. Image processing apparatus according to claim 
12, wherein said first encoded motion image data 
includes (i) intra frame coded image data and (ii) 
inter frame coded image data which is different 55 
from the intra frame coded image data. 

14. Image processing apparatus according to claim 



13, wherein said converting means extracts said 
intra frame code image data from the first encod- 
ed motion image data. 

15. Image processing apparatus according to claim 
12, wherein said second frame rate is lower than 
said first frame rate. 

'•\ - 

16. Image processing apparatus according to claim 
12, wherein said means for inputting inputs said 
first encoded motion image data from a first net- 
work. 

17. Image processing apparatus according to claim 
16, wherein said means for outputting outputs 
said second encoded motion image data to a sec- 
ond network. 

18. An image processing method comprising the 
steps of: 

providing first digital coded motion image 
data having a first encoding format and capable 
of being transmitted to a medium; and 

converting the first digital coded motion 
image data into second digital coded motion im- 
age data without decoding entirely the first digital 
coded motion image data, the second digital cod- 
ed motion image data having a second encoding 
format different from the first encoding format. 

19. An image processing of method according to 
claim 18, wherein said converting step includes 
the steps of extracting a particular code from said 
first coded image date and replacing it with a 
copy code. 

20. An image processing method according to claim 

1 9, wherein said first digital coded image data in- 
cludes (i) intra frame coded image data and (ii) in- 
ter frame coded image data which is different 
from the intra frame coded image data. 

21. An image processing method according to claim 

20, wherein said particular code comprises a por- 
tion of said inter frame coded image data. 

22. An image processing method according to claim 
18, wherein said converting step includes the 
steps of extracting a predetermined code from 
said first digital coded motion image data and 
outputting said predetermined code. 

23. An image processing method according to claim 
22, wherein said first digital coded image data in- 
cludes (i) intra frame coded image data and (ii) in- 
ter frame coded image data which is different 
from the intra frame coded image data. 
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24. An image processing method according to claim 
23, wherein said predetermined code comprises 
intra frame coded image data. 

25. An image processing method according to claim 5 
18, wherein said first digital coded motion image 
data is supplied by a video camera. 

26. An image processing method according to claim 

18, wherein said medium comprises a communi- w 
cation network. 

27. An image processing method according to claim 
18, wherein said medium comprises a recording 
medium. 15 

28. An image processing method according to claim 
18, wherein said converting step includes the 
step of converting the first digital coded motion 
image data, which has a first digital data amount, 20 
into the second digital coded motion image data, 
which has a second lower digital data amount. 

29. Image processing apparatus comprising: 

providing means for providing first digital 25 
coded motion image data having a first encoding 
format and capable of being transmitted to a me- 
dium; and 

converting means for converting the first 
digital coded motion image data into second dig- 30 
ital coded motion image data without decoding 
entirely the first digital coded motion image data, 
the second digital coded motion image data hav- 
ing a digital data amount which is less than the 
digital data amount of the first digital coded mo- 35 
tion image data. 

30. Image processing apparatus according to claim 
29, wherein said converting means includes 
means for replacing a particular code of said first 40 
digital coded image data with a copy code. 

31. Image processing apparatus according to claim 
29, wherein said first digital coded image data in- 
cludes (i) intra frame coded image data and (ii) in- 45 
ter frame coded image data which is different 
from the intra frame coded image data. 

32. Image processing apparatus according to claim 

31 , wherein said particular code comprises a por- 50 
tion of said inter frame coded image data. 

33. Image processing apparatus, according to claim 
29, wherein said converting means includes 
means for extracting a predetermined code in- 55 
eluded in said first digital coded image data, and 

for outputting the extracted code. 



34. Image processing apparatus according to claim 
29, wherein said first digital coded image data in- 
cludes (i) intra frame coded image data and (ii) in- 
ter frame coded image data which is different 
from the intra frame coded image data. 

35. Image processing apparatus according to claim 
34, wherein said predetermined code comprises 
intra frame coded image data. 

36. Image processing apparatus according to claim 
29, wherein said digital coded motion image data 
is supplied by a video camera. 

37. Image processing apparatus according to claim 
29, wherein said medium comprises a communi- 
cation network. 

38. Image processing apparatus according to claim 
29, wherein said medium comprises a recording 
medium. 

39. An image processing method comprising the 
steps of: 

providing first digital coded motion image 
data having a first encoding format and capable 
of being transmitted to a medium; and 

converting the first digital coded motion 
image data into second digital coded motion im- 
age data without decoding entirely the first digital 
coded motion image data, the second digital cod- 
ed motion image data having a digital data 
amount which is less than a digital data amount 
of the first digital coded motion image data. 

40. An image processing of method according to 
claim 39, wherein said converting step includes 
the steps of extracting a particular code from said 
first digital coded image date and replacing it with 
a copy code. 

41. An image processing method according to claim 

40, wherein said first digital coded image data in- 
cludes (i) intra frame coded image data and (ii) in- 
ter frame coded image data which is different 
from the intra frame coded image data. 

42. An image processing method according to claim 

41 , wherein said particular code comprises a por- 
tion of said inter frame coded image data. 

43. An image processing method according to claim 
39, wherein said converting step includes the 
steps of extracting a predetermined code from 
said first digital coded motion image data and 
outputting said predetermined code. 

44. An image processing method according to claim 
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43, wherein said first coded image data includes 
(i) intra frame coded image data and (ii) inter 
frame coded image data which is different from 
the intra frame coded image data. 

5 

45. An image processing method according to claim 

44, wherein said predetermined code comprises 
intra frame coded image data. 

46. An image processing method according to claim 10 
39, wherein said digital coded motion image data 

is supplied by a video camera. 

47. An image processing method according to claim 

39, wherein said medium comprises a communi- 15 
cation network. 

48. An image processing method according to claim 
39, wherein said medium comprises a recording 
medium. 9n 
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